AMENDMENTS TO THE CLAIMS: 

Claims 1-22 (canceled). 



FINNECAN 
HENDERSON 
FARABOW 
GARRETT & 
DUNNER!±f 

1300 I Street, NW 
Washington, DC 20005 
202.408.4000 
Fax 202.408.4400 
www.finnegan.com 



23. (New) A multimedia information collection control apparatus, comprising: 
a multimedia information collection unit configured to collect multimedia 

information from a plurality of kinds of input devices; 

a multimedia correspondence memory configured to correspondingly store 
the multimedia information including an image and a speech; 

an information recognition unit configured to recognize characters in the 
image, to extract a person's name from the recognition result of the characters, and to 
identify a speaker from the speech; and 

a multimedia database configured to relationally store the multimedia 
information in correspondence with the identified speaker by using the person's name. 

24. (New) The multimedia information collection control apparatus according 
to claim 23, wherein the plurality of kinds of input devices include a camera to input the 
image, and a microphone to input the speech. 

25. (New) The multimedia information collection control apparatus according 
to claim 24, wherein said multimedia information collection unit includes a display to 
output the image, and an indicator to artificially specify a recognition area of the image 
on said display. 
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26. (New) The multimedia information collection control apparatus according 
to claim 25: 

wherein said display presents an attribute selection window including a 
plurality of attribute items; and 

wherein said information recognition unit prepares a plurality of knowledge 
dictionaries each corresponding to each of the plurality of attribute items. 
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27. (New) The multimedia information collection control apparatus according 
to claim 26, wherein said indicator artificially selects one attribute item corresponding to 
the characters in the image from the plurality of attribute items of the attribute selection 
window on said display. 

28. (New) The multimedia information collection control apparatus according 
to claim 27, wherein said information recognition unit recognizes the characters in the 
image by using one of the plurality of knowledge dictionaries corresponding to the one 
attribute item. 

29. (New) The multimedia information collection control apparatus according 
to claim 28, wherein if the one attribute item is a card, said multimedia database stores 
the recognition result of the characters of the card as the speaker's personal data. 



FINNEGAN 
HENDERSON 
FARABOW 
GARRETT & 
DUNNERtif 

1 300 I Street, NW 
Washington, DC 20005 
202.408.4000 
Fax 202.408.4400 
www.finnegan.com 



30. (New) The multimedia information collection control apparatus according 
to claim 29: 

wherein said information recognition unit includes a speech recognition 
unit configured to recognize the speech in the multimedia information; and 

wherein said multimedia database stores the recognition result of the 
speech in correspondence with the speaker's personal data. 

31. (New) The multimedia information collection control apparatus according 
to claim 29: 

wherein said information recognition unit includes a face recognition unit 
configured to recognize a facial characteristic of a face area in the image; and 

wherein said multimedia database stores the recognition result of the 
facial characteristic in correspondence with the speaker's personal data. 

32. (New) The multimedia information collection control apparatus according 
to claim 25: 

wherein said indicator artificially specifies the recognition area of the 
image on said display by using a mark; and 

wherein a shape of the mark corresponds to a kind of a recognition object. 
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33. (New) The multimedia information collection control apparatus according 
to claim 32, wherein said information recognition unit extracts an area specified by the 
mark from the image, recognizes an object in the area by using the recognition method 
for the kind of the recognition object corresponding to the shape of the mark. 

34. (New) The multimedia information collection control apparatus according 
to claim 33: 

wherein said display presents a plurality of recognition area indication 
buttons each corresponding to different kind of the recognition object; and 

wherein said indicator artificially points to the recognition area of the 
image on said display, and artificially selects a recognition area indication button 
corresponding to the kind of the recognition object in the recognition area. 

35. (New) The multimedia information collection control apparatus according 
to claim 34: 

wherein said display presents the mark of the shape corresponding to the 
kind of the recognition object of the selected recognition area indication button on the 
recognition area; and 

wherein said indicator artificially adjusts a size and a position of the shape 
of the mark to the recognition area on said display. 
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36. (New) The multimedia information collection control apparatus according 
to claim 35, wherein said information recognition unit selectively uses a plurality of 
recognition methods each corresponding to a different kind of the recognition object 
according to the selected recognition area indication button. 

37. (New) The multimedia information collection control apparatus according 
to claim 23, wherein said multimedia database correspondingly stores a record 
identification of each item of the multimedia information. 

38. (New) The multimedia information collection control apparatus according 
to claim 37: 

wherein said multimedia information collection unit includes an information 
addition unit configured to additionally input information to said multimedia database; 
and 

wherein said multimedia database additionally stores the input information 
for corresponding multimedia information. 

39. (New) The multimedia information collection control apparatus according 
to claim 37, further comprising a dialogue control unit configured to input a retrieval 
request from a user, to analyze the retrieval request, and to generate a retrieval key 
according to the analysis result. 
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40. (New) The multimedia information collection control apparatus according 
to claim 39; 

further comprising a retrieval control unit configured to retrieve the 
multimedia database by comparing the retrieval key with the record identification of 
each item of the multimedia information; and 

wherein said multimedia information collection unit presents the retrieved 
information through said display. 



41 . (New) A method for controlling collection of multimedia information, 
comprising: 

collecting multimedia information from a plurality of kinds of input devices; 
correspondingly storing the multimedia information including an image and 

a speech; 

recognizing characters in the image; 

extracting a persons name from the recognition result of the characters; 
identifying a speaker from the speech; and 

relationally storing the multimedia information in correspondence with the 
identified speaker by using the person's name. 
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42. (New) A computer program product, comprising: 

a computer readable program code embodied in said product for causing 
a computer to control collection of multimedia information, said computer readable 
program code comprising: 

a first program code to collect multimedia information from a 
plurality of kinds of input devices; 

a second program code to correspondingly store the multimedia 
information including an image and a speech; 

a third program code to recognize characters in the image; 

a fourth program code to extract a person's name from the 
recognition result of the characters; 

a fifth program code to identify a speaker from the speech; and 

a sixth program code to relationally store the multimedia 
information in correspondence with the identified speaker by using the person's name. 
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